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Abstract 



O ; 

We further generalize the stochastic version of the replicator dynamics due to Fudenberg and Harris [7]. In 
particular, we add a random jump term to the payoff function to simulate anomalous events and their effects on 
the fitness. Assuming a 2 x 2 game and using a particular characteristic of the jump functions we are able to 
estimate the ergodic measure for all games. Lastly, working with results and methods developed by Imhoff [11] . 
■ we prove some stability theorems for an arbitrary n x n game. 

PQ ■ 1 Introduction 

q . Consider a two-player symmetric game, where ay is the payoff to a player using strategy Si against an opponent 
employing strategy Sj, and define A — (ay). Furthermore, define A„ = jy 6 K™ : yi > for all i and J^Vi = 

£J^' l| and A„ as the closure. Within a population we assume that every individual is programmed to play a pure 
strategy. Let Ti(t) be the size of the subpopulation that plays strategy Si at time t, which we denote as the i th 
subpopulation. Furthermore, define r(t) :— (ri(t), . . . , r n (t)) T , R(t) := r*j(i) and s(t) :— (si(t), . . . , s n (t)) T where 

Si{t) := Ti(t)/R{t) (the i th subpopulation fraction of the population^. When a player in the i th subpopulation is 

randomly matched with another player from the entire population, (As(t)J . is the average payoff for this individual, 
and we take this to be the fitness of the player. We assume growth is proportional to fitness: 

: 

n(t) = n(t){A s (t)). ) 

\ I • and hence 

> : s l (t) = s l (t)((As(t)) i -s(t) T As(t)y 

$H This is the deterministic version of the replicator dynamic. 

Fudenberg and Harris [7] make this model stochastic by assuming 



d n (t) = n(t) ^(Asit))^ + didWiit) 

for <Ji G M+ and Wi(t) a pairwise independent standard Wiener processes. Ito's lemma then yields 

dsi(t) = ^WsjW (i As ( t )) l - ( Aa ( t )) 3 ) dt + (°j s j( t ) ~ <J 2 l s l (t) s jdt + (aidWi{t) - crjdWjit) 



(1) 



The idea behind this model is that randomness comes from the fitness of each subpopulation, and hence through 
fluctuations in the payoffs. The authors then take a 2 strategy game, which makes S2{t) = 1 — Si(t), and obtain the 
more explicit model 



dsi(t) = sx(t)(l - si(i)) a i2 - a 2 2 + v\ + |an - a 2 i - o\ + a 2 2 - aia - CT2j s l(*) 
^(l-s^dWit). 



dt 

(2) 
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This takes us to a one-dimensional analysis in which there are many results. The authors are then able to determine 
the ergodic measure for all games. 

The Fudenberg and Harris [7] model simulates everyday noise very well, however, it fails to capture the impacts 
on the fitness of anomalies. There are many examples of these events, such as earthquakes, tsunamis, volcanic 
explosions, floods, an exceptional amount of toxic bonds in the stock market, etc. These are all one-time events that 
have a residual effect on the fitnesses of the subpopulations. To account for these effects we add a Poisson jump- 
term to the Fudenberg and Harris model and derive a jump stochastic differential equation version of the replicator 
dynamic. We then approximate the ergodic measure for a 2 x 2 game and a specific jump function. Lastly, following 
the work of Imhof [11J . we derive some stability results in a general n subpopulation (n x n game). 



2 The Jump Model 



Take X to be an K-valued Levy process on (f2, J 7 , P) with the filtration {J 7 t}t^R + , where J-q contains all of the null 
sets of T. For B G e(]R d \{0}) and a fixed u G fl, define AI u (s) := X u (s) - X u (s-) and N u (t, B) := #{o < 

s <t : AI u (s) G Bt\. This random counting measure is known as the Poisson measure since, fixing B, the 



map t — >• N u (t, B) is a Poisson process with intensity tv(B) := E 



N u (t,B) 



We call v(-) the intensity measure 

< oo. 



and it is well known that it is a Levy measure, hence, it is a Borel Measure with / I \x\ 2 A l\v(dx) 

Jm\{o} v ' 

The measure N u (dt,dx) :— N u (dt,dx) — dbv{dx) is called the compensated Poisson measure ^ where dt is the 

Lebesgue measure where ^ B, one can show N u (t, B) is a martingale and E JV w (t, B) \ =0, 

(which stems from v{B) < oo). See Sato [18], Bertoin [3], or Applebaum [2] for further information. 

Assuming v(R) < oo, we have E Nu(t, R) =0 and that there are only finitely many jumps in a finite interval of 

ft r 

time. It is because of these characteristics that we add the term / / hi(x)N(dt, dx) to the fitness of each respective 



subpopulation. 



Definition 2.1. We call hi{x) the jump-affect of the i subpopulation 



Thus our growth model is 

dn{t) =n(t-) ((As(t-)) At + a t dWi(t) + / h ,-(.r).Y(,//. d.r) 
We use the remark below to motivate the next assumption. 



(3) 



Remark 2.1. If we assume that inf I hi(x) > > — 1 then ri(t) can be rewritten as exp(Y^(£)) where dYi(t) 

(Mt-)),-- 



dt + <TidWi(t) + / log l + hi(x) N(dt,dx)+ / log 1 + hi(x) - hi(x) )v(dx)dt. This fol 



lows from ltd 's lemma. 



Assumption 2.1. We assume that v(M.) < oo. Moreover, for all i: 

a. hi{x) is bounded; 

b. inf | hi(x) \ > -1; 

c. hi{x) is continuously differentiate. 
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Note 2.1. Although the assumption above was presented in the context of technical issues, (guaranteeing that we 
have exponential growth), it make sense in population dynamics. If an anomaly has an incredibly detrimental impact 
on the populace then the entire dynamics has completely changed. An example of this type of impact is the polar bear 
and strategies for finding food coupled with the polar ice caps melting. 

We will assume a two subpopulation model for the rest of this section and the following section as well. In the 
latter sections we show conditions for certain stabilities for a general n subpopulation. Applying Ito's lemma ([5] 
Theorem 2 Chapter 2 §9, [2]) to si(i) yields 



dsxit) 



si 



(t-)s 2 (t-) ((As(t-)) 1 (As(t-)) 2 + s 2 (t-)al - Sl {t-)al 



si(t-) + Sl (t-)hi(x) 



si(t- 



( ai (t-) + *i(t-)fci(aO) + (*»(*-) + s 2 (t-)h 2 (x)) s ^-) + s ^-) 
s 2 (t—)hi(x)sx(t—) — s 2 (t— )h 2 (x)si(t— ) ^jv(dx) 
s 1 {t-)s 2 {t-)(a l dW 1 {t) - o- 2 dW 2 {t)) 



dt 



(4) 



sx(t-) + si(t-)hi(x) 



Sl(t-) 



(si(t-) + + (s 2 (t-) + s 2 {t-)h 2 {x)) s i(H + s *( t -) j 



N{dt,dx). 



Solving for ds 2 (t) gives us a similar equality. This particular version of Ito's lemma can be found in Applebaum 
(Theorem 4.4.7 [2]) or Gihman and Skorohod ([8] Part II Chapter 2 §6). 



Proposition 2.1. For all finite t>0 and y G A n , we have P y (s(t) 6 A n J = 1. 

Proof. The following proof is done for the n = 2 case, however, the methods used can be applied for general n. We 

2 

will first show that for t > 0, we have si(i) + s 2 (t) = 1 a.s. Define the map {si(t), s 2 (t)) — > Si(t) := G(t), and set 

i=l 

G(0) = 1. Ito's lemma gives us that 



dG{t) 




(t-)s 2 (t-) ((As(t-)) 1 - (As(t-)) 2 + s 2 (t-)4 - Sl (t-)a^j 



si(t-)+si(H^i(^) 



si(t- 



( fll (t-) + Sl (t-)M*)) + (« 2 (t-) + S 2 (t-)h 2 (x)) + *a(H 



s 2 (t—)h\{x)s\(t—) - s 2 (t-)h 2 (x)s\(t-) i>(dx) 



dt + si (t-)s 2 (t-) (aidWi (t) - a 2 dW 2 (t) 



s 2 (t-) Sl (t-)((As(t-)) 2 - (As(t-)) 1 + Sl (t-)al - s 2 (t-)alj 



s 2 (t-) + s 2 (t-)h 2 (x) 



«a(t- 



( Sl (t-) + *i(t-)M*)) + (a 2 (*-) + a 2 (t-)/i 2 (x)) Sl( ^ + 
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Si(t—)h 2 (x)s 2 (t—) - si(t~)hi(x)s 2 (t-) j v(dx) 

si{t-) + s 1 (t-)h 1 (x) 



si(t-) + 
s 2 (t-) + 



dt + s 2 (t-)si(t-)(a 2 dW 2 {t) - <7idWi(t) 
«i(t-) 



(*i(*-) + + (* 2 (*-) + «a(*-)fca(*)) + *2(t-) 

s 2 (t-) + s 2 (t-)h 2 (x) s 2 (t-) 



(si(t-) + Sl (t-)hi(x)) + («a(t-) + s 2 (t-)/i 2 (a;)) fli(i-) + s a (H 
(si(t-) + s 2 (*-))Ji/(da:)<ft 

si(t-)+*i(t-)fci(x) 



8l(t-) + 

s 2 (t-) + 



(si(t-) + si(i-)/n(a;)) + (s 2 (t-) + s 2 (t-)ft 2 (x)) si(t-) + s a (t-) 
s 2 (i-) + s 2 (i-)/i 2 (a;) s a (*-) 



(ai(t-) + «i(t-)MaO) + M*-) + s 2 (t-)h 2 (x)) si(t-) + « 2 (*-). 
(si(t-) + « a (t-)) jJV"(tft,dx) 

v(dx)dt 
v(dx)dt 
N(dt, dx) 



j 

.7 s 





+- *i(t-)/n(a;) - 


|-s 2 (t-) + s 2 (t-)/i 2 (») 


«i(t-)- 


f «a(*- 


-)] 


LMH + 


■«i(t-)fti(a;)) - 


F(s 2 (i-)+s 2 (t-)/i 2 (a;)) 


si(t-)- 


s rS 2 {t- 


-)J 




f si(t-)fti(x) H 


-aa(*-) + «a(*-)fca(a:) 


«i(H- 


Hs 2 (t- 


-)1 


L(*i(H + 


si(*-)^i(a;)) H 


-(*a(H + S2(*-)/i 2 (a;)) 




M 2 (t- 


-)J 


[ *i(H 


+■ s x {t-)hi{x)- 


Fs 2 (t-) + s 2 (i-)/j 2 (x) 




f s 2 (*- 


-)1 


L(«i(*-H 


■ai(t-)fti(x)) - 


F(s 2 (t-)+s 2 (t-)/i 2 (a;)) 




f s 2 [t- 


-)J 



(1 - l)N(dt,dx) = a.s. 

Finally, we show that the stochastic replicator dynamics does not hit or jump over the boundary in finite time. 
Define ^(y) = log(yi/j/ 2 ), r as the first time this dynamic leaves the simplex (i.e., such that Si(r) < for some i), 
and Z(t) := ^(s^)) for t < r. Ito's lemma yields 



dZ(t) 



(1, -l)^*- 1 ^^-)) + \{a\ " O?) + jT (W) - h x (x) + log Q + ^|^ ) ] 
+ C r 1 dWi(t)-cr 2 d^ 2 (t)+ / logf j-^44 V(^^) 



dt 



where 



Sl (t) 



1 + h 2 {x)_ 
Si(t) _ si(t)/s 2 (t) 



,Z(t) 



si(t) + s 2 (t) si{t)/s 2 (t) + l e z W+l' 
1 

s 2 (t) 



Z(t) , x ' 



and 



e« + 1 



(eM) 



Take £ as the infinitesimal generator for Z(t). To apply Theorem 2.1 in Meyn and Tweedie [T7], we need to show 
that there exists a non-negative ip £ C 2 (R) such that lim ip(y) — oo, and a positive constant A where Slip < \ip, in 

|l/|->oo 

order to conclude that P(r = oo). By Theorem 2 (Part II Chapter 2 §9) in Gihman and Skorohod [5] (or Chapter 6 
§7 [5]), the generator of Z(t) has the form 



+ 



'■i' +, --i™n-'-"" 



v(dx), 
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where 



a*(y) = (1, -l) T A*-\y) + 1(4 -^)+J R ( h *W ~ h^xfyidx). 
Note that \a(y)\ is bounded by a constant, say K. Now take tp(y) = 1 + y 2 . Then 



£tp(y) = 2a(y)y + (aj + a 2 ) + jf L + log Q 



1 + fei(x) 

/i 2 (x) 



v(dx) 



2 a 



< 2 iiT 



1 + ^»)^,) 9+W+ , 2 V//o/(^M)^):^( 9 ). 



log 



1 + /i 2 (x 
iting that 

Tweedie [T7], P(r = oo) = 1, which finishes the proof. 



Defining A = max </>(y) and noting that (j> is linear, yields £w < \w. Therefore, by Theorem 2.1 in Meyn and 
i/e[-i,i] 1 

□ 



By the proposition we have the equality s 2 (£) = 1 — Si(i). Hence, we may just focus on the dynamics of 

fti(x) — /i 2 (x) 



d»i(t) = «i(t-) l-«i(t-) 



0-X2 — 0,22 + C 2 



si(t-)[/ii(x) -/i 2 (x)] + l + /i 2 (x) 



+ ft 2 (x) — /ii(x) z/(<ix) 



an - a 2 i -cr 1 + a 2 2 - a 12 - er 2 Si(t-) 



dt 



+ a Sl (t-)[ l-si(i-) dW(t) 



Sl (f-)[/n(x)-/i 2 (x)] + l + fr 2 (x) 1 ' h 



a 1 W 1 {t) - er 2 W 2 {t) 



(5) 



where cr := erf + erf and 



Remark 2.2. Defining H(s(t-)) := 
ficient can be written as 



hi(x) - h 2 {x) 



si(t-) l-si(t-) 



si(i-)[/ii(x) -/i2(»)] + l + /i 2 (x) 



012 - a 22 + a\ + H(s(t—) 



+ /i 2 (x) — h\{x) v(dx), the drift coef- 



(au - oai - ct? + # («(*-)) + («2 2 - o ia - of - #(»(*-)) J 



(6) 



or ^4 



Moreover, if h\(x) — h 2 (x) for every x £ R iften i/ie jump terms disappear. Recall that for A :— [ ° n C ° 12 

\ "j i + c a 22 

an ai 2 + c \ we /j a?; g £/j e e q Ua Uty ( Ap) — p ■ Ap = (Ap)- — p ■ Ap for i — 1.2 fjfl) /. which is what we 
«2i 022 + c y V / i 

would expect. Furthermore, if an anomaly were to affect the environment in such a way that the subpopulations are 
equally effected, we would not expect unequal change in their fitnesses. For an example of such an event consider the 
scorpion population in the American southwest and how each subpopulation is subjected to flooding. The amount of 
food is impacted equally across each subpopulation as well as the chances of individuals drowning. 
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3 An Approximation of the Ergodic Measure 



In this section we determine the stability for a 2 x 2 game for a certain class of jump-affect functions. In particular, 
we give conditions that estimate the long-run behavior of our process. Since s 2 (i) — 1 — s±(t), we simplify the analysis 
by only considering the dynamics of Si(i) with respect to Equation (5) (Theorem 2 Part II Chapter 2 §9 [5]). Notice 
for 

&(v) -■ 2/(1 - y) 



and 



ai2-a 2 2 + vl+ j yi 2 (x) - hx(xyjv{dx) j + ^(a u - a 21 - of) + (a 22 - a 12 - of)Jy 



fa) :=yy 2 (l-2/) 2 , 

= y(l-y) [M*)- W] = + 

V 1{lJ,X > ■ V y[h 1 (x)-h 2 (x)]+l + h 2 (x) y[h 1 (x)-h 2 {x)]+l + h 2 {xy 

and taking L as the infinitesimal generator of s\(t) given by Equation (5), we have 

Lf(-) = 5(.)/'(.) + £(•)/"(•) +f (f(- *)) - /(•)) "(<*=)• 

Now, for < yi < y 2 < 1, define r yia2 (y ) = inf jsi(i) (yi, y 2 ) si(0) = y j, ^y 2 - m (yo) = p(si (r yiy2 (y )) > y 2 ), 
and 7r vi;U3 (j/ ) = f («i (t„ iV2 (j/o)) < 2/^ 



Consider an integro-differential equation on the unit interval of the form 



Lu(y) = a(y)u'(y) + (3(y)u"(y) + J u(y + j(y, xfj - u(y) v(dx) = for y G (yi,y 2 ) 



(7) 



with the conditions u(y) = for y € [0, yi], and u(y) = 1 for y S [y 2 , 1]. The papers of Henry Tuckwell [22] and 
Mario Abundo [1 tell us that solving this integro-differential equation will give us % 2 ;j/i(2/o)) ^interchanging the 

initial conditions will give TTy i:y2 (j/o)J • However, in order to apply these theorems we need to verify the condition 
_E[r^ ia2 (yo)] < oo for every n G Z+. This property is shown in Theorem 4.1. 



Remark 3.1. We should note here that the result in Tuckwell [22] is for a jump- diffusion with a Poisson measure and 
not the compensated Poisson measure. However, Tuckwell's proof is based on a result in Gihman and Skorohod JSjj, 
in which the authors give an equality for the transition probability for a jump- diffusion with a compensated Poisson 
measure (^Part II Chapter 2 §9j . Adjusting the first order coefficient by adding the integral with respect to the Levy 
measure and proceeding similarly will give the equivalent conclusions. 



Solving this integro-differential equation is a very difficult task and so we will construct a way to approximate the 
solution. First we assume that h\(x) = h 2 (x) + e, for a small e G R. This assumption tells us that one subpopulation 
fairs a little better than the other. Next we will turn the difference in the integral into a Taylor series, using e as the 
variable, grouping the higher order terms into an error term. Note that we will use the function /, instead of u, to 
find the solution, since normalizing / and considering the initial conditions will determine u. 

Before we begin we need the function / to be in an appropraite space. Given < y% < y 2 < 1, define yi 

m in \ yi,y + i(y,x) > and y 2 = max <^ y 2 ,y + j(y,x) }. Note that < yi < y 2 < 1 since y + ~f(y,x) = if 

xm,y£(yi,V2) L > xeR,y£(yi,y 2 ) t > 

and only if y = and y + 7(y, x) = 1 if and only if y = 1. Define C yiy2 as the space of bounded continuous functions 
that map [yi,y 2 ] to R, and take / G (g G C yiy2 : g' G C yiV2 and g" G C yiy2 \. 

By our assumption on the jump- affect functions, the integral difference term is 



/ 



ey + l + h 2 (x) 



v{dx) := F(e). 
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Then, by our assumption on /, F(0) = 0, 



M 

JR \ 



, (y[l + h 2 (x) + e]\ (y[l + h 2 (x) + e] 



£=0 



and 



F"(0) 



r ( y[l + h 2 {x)+e] \ ( y(l-y)[l + h 2 (x)] \ 
Jr V W + l + Wx) J V (ey + l + h 2 (x)) 2 J 

= y(i - V )m I Trh*)" {dx)=Ciy{1 - y)m > 



I y[l + h 2 (x) + e] \ / y(l -y)[l + h 2 (x)] 
\ ey + l + h 2 {x) J y ( ey + 1 + h 2 (x)) 2 



£=0 



+ / 



, (y[l + h 2 (x)+e] \ ( ' -2y 2 {l-y)[l + h 2 (x)} 



> v(dx) 



£=0 



^ ey+l + h 2 {x) J y ( ey +l + h 2 (x)) 

= -2y 2 (l-y)f(y) f - 1 V {dx) + y 2 (l - yf f" {y) f 1 2 v(dx) 

Jr 11 + ho(x)\ Jr [1 + h 2 (x)\ 



Jr [l + h 2 (x)]' 
= -2C 2 y 2 (l y)f{y) + C 2 y 2 {\ y) 2 f"(y), 



where C\ :- 



-v(dx) and C 2 :- 



;v(dx). Thus 



l + M*) v ' " ./r [1 + ^ 2 (x) j 

F(e) = Ciy(l - y)/'(2/)e + ( - 2C 2 y 2 {l - y)f{y) + C 2 y 2 (l - yf f" (y)) e 2 /2 + 0(e 3 ). 
Excluding the error term, Equation (7) becomes the ordinary differential equation 

ae(y)f'(y) + Pe(y)f"(y) = o, 



where 



a e (y) := y(l - y) 



a\i - a 22 + a\ + e((Ji - ^(R)) j + { (an - a 21 - a 2 ) + (a 22 - a 12 - a 2 ) - e 2 C 2 }y 



and 



2 2 



C 2 y 2 (l-y). 



Remark 3.2. Without the quadratic term in our approximation we would have f3 e (y) = ^— j y 2 (l — y) 2 , and if 
a i = a 2 = then /3 e (y) = 0. Hence, the quadratic term is included to insure that /3 e (y) > for all y E (0,1). 



Remark 3.3. Since we are approximating the exiting time of our stochastic replicator equation, we will define the 
"new" process as s(t) — (s\(t), s 2 (t)) . 



We are now ready to state the main theorem for this section. The statement of the theorem is given from the 
perspective of the dynamics of §i(t), however, since s 2 (t) = 1 — s t (t), understanding how s\(t) evolves tells us how 
S 2 (t) evolves as well. 
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Theorem 3.1. Take s(t) = (§i(t), s 2 (i)) in the remark above, A = ( I , of the variance of the i th 

\ 0-21 0-22 J 

subpopulation, C\ and C2 defined above, and y = (yo,y'o) G A 2 . 

22 2 22 2 

(%) If a n - 021 < gl 2 g2 - e(d - i/(R)) + ^-C 2 and a 22 - a 12 > ° 2 ~ ° l + e(c\ - i/(R)) - yC 2 , i/ien 

P yo (lim si(i)=0) =1. 

2 2 2 2 2 2 

(ii) If a n - 021 < gl ~ g2 - e(Ci - i/(R)) + ^-C 2 and a 22 - a 12 < - ~ gl + e(d - i/(R)) - i-C 2) tten 
P yo (lim sup si(i) = 1 ] = P yo (lim inf si(t) = 0) = 1. 



T 2 ^2 



// an - 021 > gl ^ - e(d - i/(M)) + |-C 2 and a 22 - a 12 < ° 2 ° x + e(d - i/(R)) - yC 2 , t/ien 
( lim Si(t) 

\t— >oo 



P yo ( lim si(t) = l) = 1. 



^2 „2 „2 



// a n - 021 > ^y^ 2 - - e(d - i/(R)) + i-C 2 and a 22 - a i2 > + e(d - i/(R)) - i-C 2) then 



Proof. We will prove this theorem by proving four lemmas, where the lemmas correspond to each particular case of 
inequalities. □ 



Before we prove each lemma we give some intuition behind the inequalities in the theorem above, and use these 
details as a basis of our proofs. Using an integrating factor, we see that 



l Jyo Paz) 



lya h>e{z) 

for some constant k\ and y € (3/1,2/2)- We now simplify the integral in the exponent. Define N e — a 12 — a 22 + of + 
e(c\ - f(R)) and M t = (an - a 2 i - of) + (a 22 - a i2 - of) - e 2 C 2 . So 



AM ' V2 2 V y z(l-z) 



J/0 



(^# + 4c 2 ) 1 (/v £+ m £ ) N 



log (3//3/o)" (#+4C2) " ljVe ((l-3/)/(l-3/o) 



For some constant k<± we have 

(2 2 \ — 1 
V + VC2) IV, 



f(y) = hj (z/yo) K 1 ^(l-z)/(l-ito)J d*-fc 

==*i/ y (v».)" jv ((i-*)/(i- w ,y 



M 

dz — fc 2 



2/0 

hy 1 ~*2F 1 (-M, 1 - JV, 2 - iV, 3/) - fc 2 



2 2 \ — 1 /2 2 \ — 1 



where M := ^ — + — C 2 J {N t + M t ), N := + —C 2 j N t with the assumption N ^ 1, 2-F1 is the hyperge- 

omctric function, fci := ^ s— j and fc 2 := -kiyl~^ 2 Fi (~M, 1 — N,2 — N, y ) - fc 2 - 

(1 - 3/o) M (l - 1 v / 
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Defining u(y) = -j— — ^, f(y) = f(yi) for y G [0,yi], and f(y) = f(y 2 ) for y £ [y 2 ,l], we see that 

f{y2)-f{yi) 

ot e (y)u'(y) + P{y)u"{y) = for y 6 (2/1,2/2), «(2/) = for y e [0,2/i], and 14(2/) = 1 for y 6 [2/2,1]. 
Note that 



~2 ^2 \ -1 



022 



/ \ e 2 

a X2 - of - e[d - i/(K)J > -o 2 /2 - -C 2 



»22 — Oi2 



>^_^ + e (a 1 -,(R))-i-c72 



and 



y + yC 2 J (2V e + M e ) > -1 ■<=>■ a u - aai - of + e[d - ) - e l G 2 > -o 2 /2 - -C 2 

2 2 

an - aai > CJl ~ CJ2 - eld- u(R) ) + ^-C 2 . 



We also conclude that 



_ + -c 2 I iV e < -1 <=► a 22 - ai2 < - 2 1 + e(Ci - i/(R)J - yC 2 



and 



9 2 \ — 1 



y + yC 2 ) (JV e + M e ) < -1 ^ a n - a 21 < -L__2 - e(d - u(R) ) + -C 2 



Using arguments similar to those in Gihman and Skorohod ([5] Part I Chapter 4 §16) we have the following 
lemmas. We will only prove the first lemma, keeping in mind that the rest of the lemmas are proved similarly. 



Lemma 3.1. If we have the inequalities 

22 2 22 2 

an - aai < - 6 { Cl - K M )) + and a 22 - a 12 > ° 2 ~ ai + e(d - v(R)J - i-C7 2) 

(hence, lim fix) — 00 and lim fix) < 00), then 

P yn fsup«i(t) < l \ = P ya (inf h(t) = 0)= P ya (lim h(t) = 0) = 1. 



Proof. We will follow the proof in [8 . Since lim P ya ( si(r yii , 2 (y )) > 2/2) = fy ( supsi(i) > 2/2 ], we have the 

yi^° ^ ' \t>o J 

equality P ya (supsi(i) > 2/2 J = 77^ 77t!t- Letting 2/2 — )• 1, we conclude that P yo ( supsi(t) < l) = 1. Also 

\ t^n I tiu9.) — t (0) V / 



P yo [ inf 



*>o - '-"7 /(2/ 2 )-/(0) 
(inf §i(t) < 2/1 J > iy (siK iy2 (2/o)) < 2/l) = /(^) _ /(^°) ~> 1 as y2 ^ I- 



Showing that P yo ( limsupsi(i) > y 2 I =0 will finish the proof. Dchne r q to be the first time passage of the 



process past or to the point q < y$. By above we have P yo (r q < 00) = 1. Furthermore, since r q is a stopping time 

*(0) = = Moreover P yo (jupsi(t + r,) > y 2 



P yo supsi(t + r g ) > y 2 = P yo supsi(t) > j/2 
,t>o / \t>o 



P yo sup si (£) > j/ 2 > P yo ( lim inf si (t) > y 2 ) . Thus, taking g->0we obtain P yo ( lim inf si (t) > y 2 ) = 0. There- 
fore lim inf Si(t) = a.s. and we are done. □ 

t— >oo 



9 



2 „2 £ 2 



Lemma 3.2. If we have the inequalities 

2 2 2 

an ~ aw < — ~ g2 - e(Ci - i/(R)J + yC 2 and a 22 - a 12 < ^ 2 ~ °" x + e(c 1 -v 
(hence, lira /(a;) = oo and lirri /(a;) = oc^ , i/ien 

P yo (lim sup si(t) = 1 ) = P yo (lim inf si(i) =6) =1. 

V t-i-oo / V ' 

Lemma 3.3. // we have the inequalities 

2 2 2 

an - 021 > <Jl ~ g2 - e(Ci - K R )) + yC 2 and a 22 - a 12 < °" 2 ~ °" x + e(Ci - i/( 
(hence, lim /(x) < oo and lini f(x) — oo^, then 



- 2-Ca. 



2 _ „2 , N £ 2 



-C 



2. 



F yo ( fof^t) > Oj = P yo ( supSiW = 1 ) = Py ( Km S x (t) = l) = 1. 



Lemma 3.4. //we /iave i/ie inequalities 

2 2 2 2 2 2 

an - as! > - e(c x - i/(R)) + ~C 2 and a 22 - a 12 > ^ ~ gl + e(Ci - i/(R)) - ~C 2 , 

(hence, f(x) < oo Vx), then 

/(i)-/(yo) 



P yo supsi(t) < 1 = P yn ( lim Si(t) = 



*>o iW J yo Vt^oo - ' 7 /(l)-/(0) 

/(wj) - /(0) 



P yo ( gfi l(t ) > Oj = P yo yim = Ij = _ 



This is very similar to the results found by Fudenberg and Harris [7], with the added or subtracted piece e((Ji — 

u(W) j C 2 . There are cases which the compensated Poisson term does not affect the dynamics of the underlying 

diffusion model (given by Fudenberg and Harris [7 ), in particular, if the differences of the jump sizes are small. 
However, there are cases which the compensated Poisson term would influence the dynamics of the underlying 
diffusion. We now give such an example. Recall that v (R) gives us the intensity of the jumps. If h^ix) > for 

a significant amount of x £ R then C\ < f(R). Consider the inequality an — a 2 i > 1 - — - where er 2 > o\ and 

2 2/ 2 \ 

an — a 2 i < 0, and hi(x) > for a significant amount of x G R. If 1 - — - — ( e(C\ — ^(R)^ — 2^/ ^ ^' WS 

have the inequality an — a 2 i < 1 - — - — {^{p 1 — ^(^)) — 2^^) ' wllicil cnarL g es the dynamics of the stochastic 
replicator. 



Remark 3.4. In most applications to this type of modeling, the Poisson measure and not the compensated Poisson 
measure is used. This is a simple adjustment of replacing the term e((Ji — ^(R)J with eC\. It should be noted that 
this new term has more of an impact to the inequalities of the payoffs and hence the dynamics. 
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4 Evolutionary Stable Strategies 



The rest of the work in this paper will be based off of a paper written by Imhof |llj . Take {ei, ea, . . . , e n } as the 
standard basis of R ra . For the Euclidean norm ■ |, define Us{y') — {y S A„ : |y' — y| < 5} and tq — inf{£ > : 
s(t) G G}, where G is a Borel set. 

For the general n subpopulation model, we have Si(t) is of the form 



dsi(t) = Sj(t-) 



+ 



1 + Ma;) 



l + /ii(a;) 



1 + Sj(t~)hj(x) — hi(x) v(da 



dt 



+ *»(*-) 



- 1 N(dt,dx). 



(9) 



Define h(x) = (/ii(a;), fe 2 (a;), . . . , ft„(a;)^ and W(t) = (Wi(t), W^(i), • ■ • , W n (t)J . With a little work, one can 
see that 

ds{t) = D 1 (s(t-),h(x))dt + D 2 (s(t-))dW(t) + J D 3 (s(t-),h(x))N(dt,dx) 

where 



D 1 (y,h(x)) = diag(y 



,2/n) - yy 



A-diag(o- 2 ,...,cr 2 ) 



/ (yh(x) T -diag(/ii(x),...,/i n (a;)) 

JR V 



i + y T h(x) 



diag(l + hi(x), . . . , 1 + h n (x)) - diag(l, . . . , 1) y v[dx), 



and 



D 2 (y,h(x)) = diag(yi, . . .,y„) - yy T diag(cri, . . . ,cr„), 



£> 3 (y,h(a;)) 



1 + y T h(a 



-diag(l + hi(x), . . . , 1 + h n (x)) - diag(l, . . . , 1) y 



Denote Aj as the infinitesimal generator for our process defined by equation (9). By Theorem 2 (Part II Chapter 
2 §9) in Gihman and Skorohod [8], we see that 



Ajffr) = £ D) (y, Hx))^(y) + \ £ 7jfc (y) 



9 2 / 



(y) 



+ jf (l? 3 (y, h(x)) + y) - /(y)) i/(dar), 
where Z?* is the j th coordinate of the function D l , 7jfc(y) = c jl(y) c kl (y) for Cji(y) — ' ' ' '' ' ' 



and 



^(y-MaO) :=2/i(ei-y) T A - diag(cr 2 , . . . , cr 2 ) y + / ^ £ Vkh k (x) - hi{x) \v{dx). 
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Before we prove theorems about certain stabilities, we show that our stochastic replicator dynamics evolve close 
to e k , for some k G {1, . . . , n}. Since the corner points of the simplex are absorbing, this is how we would expect the 
dynamics to behave. 



Theorem 4.1. Take s(f) to be an n- dimensional stochastic replicator dynamic defined by Equation (9), the matrix 
A as an arbitrary payoff matrix, and for e > ; define T e := inf (t > : s k (t) > 1 — e for some k G {1, 2, . . . ,7i}j. 
Then for y G A„ , 

E y [r e ] < oo, 

and 

P y ( supmax{si(t), . . . , s n (t)} = 1 ) = 1. 



Proof. We will follow the proof of Theorem 4.3 in Imhof 11 . For a > and y G A n define the positive function 
g(y) = ne a — ^^e ayk . Define the "new" payoff matrix A := A — diag(crj, . . . , er^) and the infinitesimal generator 

ft: 

Aj. Then 

2 



Ajg(y) = -a £ Vk{e k - yfiye ™ ~ — £ y\ ( a\{\ - y k f + £ ofo- ) e° 



- a / Vy fe VV^(V) - /i fe (V) e ayk v(dx) 

+ X E«p{^}-E«p( 1+E iVMx) ) 



v(dx) 



For (J m i„ := min{<7i, . . . , a n } and a constant /3 > such that \(e k — y) T Ay| < (3 for all y G A„ and all 
fc G {1, . . . , n}, Imhof showed that 



i E - y) T ^ Qafc - \ E ^ 2 ^ a E ^ Q!/ 



£-^^(1 -</*)' 



(10) 



Furthermore, for k 
K m i n Ji/(dx), we have the inequality 



max := supmax{/ii(j), . . . , h n (x)}, k 



min := inf mxa{hi(x), . . . , /i n (x)}, and M 



a [ Vy t \-J2vjhj(x)+h k (x) ] e°»V(dx) < a YVe^M. 



(11) 



Recalling the inequality — e 2 < — 1 — x for a; > 0, we have 



f sr^ r t ( ay k (l + h k (x)) \ 

y^E-p{^}-E-p{ 1+E? . yA . (cc) ) 
^E 

ft: 



v(dx) 



r , , ay k (l + h k (x)) 
exp{ay k \ - 1 - -— - 

i + 2^yAw 



v(dx) 
v(dx) 
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E 



a-Vk 



< 



E 

n=l 

oc 

E 



(ayk) 



1 + h k (x) 



v(dx) 



i! 



v(dx) 



cxp{-ay k }^2 



(12) 



v(dx) 



= ^2 ay k exp{ay k } 

k 

- a E yfc ex P{«2/fe}^( R ) ■ 

fe 

Collecting Equations (10), (11), and (12), we see that 

Ajg(y) < a ^ Vke aVk (/? + M + 



2 

Now for an arbitrarily small e > 0, choose a > large enough that ?i + 1 for all 

y 6 [i, 1 — e] . Furthermore, take y € A n such that yi < 1 — e for all i. For our y, there is at least one y k such that 
y k > — and hence 



-Z/fc(l - 2/jfe) 



A/<?(y) <a(/3 + Af + ^(M)) Vke ayk +a E Vk& aVk ( — (n - 1)^/3 + M + - 1^ 

fe: Vk<l/n fe: t/ fc >l/n 

< a[fi + M + z/(E)J(n- 1)- + a ^ - (n - 1) + M + v(TSL) J - lj 



Now by Dynkin's formula for every finite T, 



< E v 



,(s( 



T f AT 



s(y) + Ey 



t,AT 



A/.g(s(t))* 



„a/n 

< ne a - a E v 



r f AT 



Therefore, by the monotone convergence theorem, letting T — > oo yields the inequality E y [tJ < n 2 — . 

a 

Finally, take e = 1/m for m £ N. Then P y I supmax{si(i), . . . ,s n (t)} > 1 — 1/m ) = 1, and therefore 

V t>o J 



1 = p y[ fl supmax{si(/j), . . .,s n (t)} > 1 - l/m \ ) = P y [ sup max{si(t), . . . , s n (t)} = 1 
Vm=i t>0 J / V t>o 



□ 



Take A to be a payoff matrix for a game. A strategy p £ A„ is called an evolutionary stable strategy if: 
q T Ap < p T Ap for all q £ A„; and for q € A„ where q ^ p and q T Ap — p T Ap, we have that q- Aq < p • Aq. Imhof 
[llj noted that the concept of an evolutionary stable strategy, although a stronger notion than a Nash equilibria, is 
not strong enough to hold by itself in a stochastic setting. The author adjusted for this weakness by assuming the 
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payoff matrix is conditional negative definite, which is defined below. From these assumptions, the author was then 
able to show conditions for stability near an evolutionary stable strategy. We utilize this technique developed by the 
author. 



Definition 4.1. A matrix A is said to be conditionally negative definite if for y £ R ra \{0} where l T y = 0, we have 

y T Ay < 0. 



Lemma (Imhof [llj). Suppose that A is an n X n (n > 2) conditionally negative definite matrix, define A = 
— (A + A T ^j and let A 2 be the second largest eigenvalue of 



D:=A - -A11 T - -11 T A + ^-^11 T . 

n n n 

Then 

x T Dx x T Ax 
max — = — = max — = — = A 2 < 0. 
x T l=0 x J x x T i=o x J x 



Define d(y,p) = pj log (pj /yj), where log (pj/yj) = if pj — or yj = 0. This is the known as the 

3 

Kullback-Leibler distance. We are now ready to state and prove the theorem. 



Theorem 4.2. Take s(t) as above, p G A„ an ESS for our payoff matrix A, which we assume is conditionally 
negative definite, and A 2 as the second largest eigenvalue of D. Define 



K J = o X^' CT f ~ ^ — =2 + / max/ifcOMcfa;) 
- 2 Jm. k 

I v(dx) — y pj I hj{x)v(da 



Ef ( 1 + maxfe h k (x) 



and assume that < kj < 



hj(x) 



vlAal min p,-. Furthermore, assume 

71—1 l<j<n J 



that J f ^(pj - V])hj{x) - l\v(dx) < 



for all y € A n . Then for 5 > such that S 2 > Kj/|A 2 |, y € A n , and t > 0, we have the inequalities 

v rv i < d (y>p) 



(13) 



s(u) - p 



du 



< 



1 /d(y.p) 



|a 2 | 



Lastly, an invariant measure ir(-) of the stochastic replicator dynamic, exists, is unique, and 



> 1 - 



|A 2 |£ 2 ' 



(14) 



(15) 
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Proof. Our proof will very closely follow the one given by Imhof [TT] . For p £ A„ an ESS for A, define the function 
v(y) — J2jPj 1°S (Pj/Vj)- Applying Aj (the infinitesimal generator) to v, we see that 



Ajv{y) 



^Piiei ~ y) T [A - diag(of, . . . , a 2 n )\ y+r^ \A ~ 2y J cr J + XI y k c r 



E 



V Vkh k (x) ) v(dx) + VV- / log 



1 +Y,kVk h k{x) 

1 + ftj(a;) 



v(dx) 



= (y - p) T Ay - 5 E + 5 ~12 p i f R ^ " E ^M^J v(dx) 



< (y-P 



log 



T ^y 



log 



1 + J2kVkhk{x) 



v(dx) 



1 + 



3 

max fe h k (x) 



l + h 3 {x) 



v(dx). 



In the proof of Theorem 2.1 in [TT], Imhof showed that (y — p) T Ay < A 2 |y — p| 2 and — - ^ < 



-2 ' 



Thus, for y e A„, 



A/v(y) < A 2 |y - p| 



By Ito's lemma, the process 



nj ]E 



Our assumption S 2 > k 2 /\X 2 \ tells us for y e A„\[/,5(p), A/«(y) < A 2 <5 2 + 
v(s(t)) — (A 2 <5 2 + K 2 )t is a local supermartingale on the interval [0, T u s ( p ))- Therefore v(y) > ^ | A2 1 <5 
which shows Equation (13). The strong Markov property tells us that the stochastic replicator dynamic is recurrent 

|A 2 min pj, Imhoff |11) in Theorem 

l<j<n 



in the set Us(p). Furthermore, by choosing a <5q > where kj < Sq < 



n-1 



2.1 showed that A„\|a„ n <5 (p) = 0- Thus, our process never hits the boundary and we are able to pick any 
5 > for which the inequality holds. 

Now define r^. = inf{t > : v(s(t)) = k}, where k > v(y). Applying Dynkin's formula we see that 



< E„ 



v(s(t Ar fe )J = v(y) + E y 

tATk 



tAT k 



Ajv(s(u)j 



du 



< v(y) + A 2 E y 



\s(u) - p| du 



+ KjEy [t A Tfc 



Since t A —> t as k — > 00, the bounded convergence theorem yields Equation (14). 

Finally, to show Equation (15) we need to show that the transition probabilities converge in total variation to 
an invariant measure (which makes this measure unique). To accomplish this task we will apply Theorem 5.2 in 
Down et al [1] . In order to satisfy the hypotheses of the theorem, we need to show that our process is ^-irreducible 
(page 1674 [J]) and aperdiodic (page 1675 [1]). To show the ^-irreducible condition, we define the Borel measure 



tp(0) = M[0 n U$(p)j , where M is the Lebesgue measure, and r\o : = J l{s(t)eo}^ (the occupancy time). Since 
we know our process is recurrent in Us(p) , if ip(0) > then E y [?7c>] > 0. 

To show the aperiodic condition we need to find a small Borel set B and a time T such that P y (t, B) > for all 
t > T and all y 6 B. A clear candidate for B is the set Ug(p). Before we show this conditions holds, we will note 
that since the Poisson measure is generated by a Levy process, (and so the initial condition for Levy process is Dirac 
measure do), independent of all the Wiener processes, the jumps are only dependent on time. 

To show that this condition holds, we will follows the proof of Claim 1 given in [15] . Since z/(M) < 00, we may 
rewrite s(t) as 



s(t)=y+ [ D 1 (s(t-),h{x))dt+ [ D 2 (s(t-))dW(t)+ [ f 

JO JO JO JR 



D 3 {s(t~),h(x))N(dt,dx), 
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where 

D 1 (y,h(x)) = diag(yi,...,y n ) - yy T A - diag(cr?, . . . , a%) 



yh(x) T - diag(fti(x), . . . , h n {x))v(dx) 



For the finite interval [0,f'] (for any t' > 0), there is a positive P y probability that a jump does not occur. On this 
event, s(t) agrees with the process 

I(t)=y+/ D 1 (\(t),h(x))dt+ f D 2 (\(t))dW(t). 



Thus, considering Theorem 2.1 in Imhoff [TT], the condition holds. 

Lastly, we need to show that AjV(-) < — cV(-) + 61[/ 5 ( p )(-) where V > 1, V € and c, 6 > 0. Define 

V(y) = if + H y^ Pl , where if is a positive constant which will later be determined. So 



A,,V(y) = -Y,Pr 



(e< - y) T A - diag(er 2 , . . . , er 2 ) y + / ( ^ yA(» - ^(z) ) 



n 



(l^yf + E^f 



2 



E2 2 2 2 



IL 



+ jf (V(# 3 (y, h(x)) + y) - V(y)^v{dx) 
= (y - p) T Ay ■ J] ^ ' + / - y^ixHdx) • J] + £ y^fo - y,)«7| • II fP" 

+ j> [(i - 2yi )a| + 2 y y~\ n y r P! - 5 E» E w k 1 - 2 ^ 2 + E II ^ 

+ ^EEP*f*fe^" f,i ^" y *^lnwr P, + / (^(^ 3 (y,h( 2 ;))+y)-F(y))^) 
= (y - pf Ay JJyj-« + / - V] )h 3 (x)v{dx) . JJj,^' + - y>| • ^" Pi 

-JEE^[( 1 -wK a +tffc^]lI»r P, + / (v(D\yMx))+y)-V{y)] V (dx) 
< (a 2 | P - y| 2 + Eft(l - + (E^Pj ~ ~ ^K^) 



~ o e E K ^ _ y4 )^ 2 + ) n 



Vi 



i k^i 



1 + maxj hj(x) 
1 + minj hj (x) 



idx) :=C(y)IIyr P, +^ 



for 



C(y) = A 2 |p - y| 2 + E^ _ fi)oi + / ( E^ " %)M^) " 1 )"(<*"0 ^ o EE» ft 1 " Vi)°i + 



Vko\ 



and 



To finish the inequality, we note that 



1 + maxj hj (x) 
1 + mim, hj (x) 



v{dx). 
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v(y) 



V{y) + V(y) / 



%)<(c(y) + ^)F(y). 



By our assumptions C(y) < for y 6 A„\L^(p). Thus, taking K large enough so that C(y) + < for all 
y G A„\[/5(p) and V > 1, we are able to find a constants c, b > such that ■AjF(y) < — cV(y) + bl Us ( p )(y) holds 
for all y G A„. 

Defining O c := A„\0 and 7r(-) as the invariant measure, we have 



-(u s (pf) 



lim E v 

t-HX> 



< lim E v 



1 /-^sM-pl 5 



< 



|A 2 |5 2 ' 



and therefore Equation (15) follows. 



□ 



5 Strict Nash and Stochastic Stability in the Presence of Continuous 
and Random Jumps 

We call a strategy p G A„ a strict Nash Equilibria if for q G A„ such that q / p, q T ^4p < P T ^P- In this 
section we examine strict Nash Equilibria and how random jumps and white noise affect the stability of replicator 
dynamics. Throughout this section take pure strategy S k as a strict Nash Equilibria, i.e., akk > a-jk for all j ^ k. 
Since the characteristics of the jumps are able to impact stability we define the functions ipmin( x ) := mm hj (x) , 



ib k 



(x) := m&xhj(x), and tp 

j¥^k 

(h k (x) -4>tin( X )) 2 ,, , , T k f 

u(dx) and I 2 ■= 

Jr 



(x) := m&xhj(x). Furthermore, from these functions we define the integrals l\ :- 

3 



i>Ln(x) 2 + hk-{l + h k (x))i> k max (x) 



1 + Ipmax(x) Jr 1 

the theorem below, for A defined in Theorem 4.1, define 



' ^maxix) 

:= max{|ajj 



v{dx). Finally, for the purposes of 



: 1 < j,i < n}. 



Theorem 5.1. Take the matrix A and the process s(t) defined in Equation (9). Assume that for the pure strategy 
S k and the corresponding variance a\, we have the inequality a k k > a jk + Oj f or °JJ 3 7^ k (hence S k is a strict Nash 
equilibrium), hi(x) is nonnegative for all i, and —2/3 + 1% > 0. Furthermore, for a > 0, where a + ajk < a k k — o\, 
assume a + 2(3 — 7f > 0. Then for every S > 0, 

P,(lims W = e fc )>l-l^|. (16) 

Proof. Take A as in Theorem 4.1. Applying the infinitesimal generator Aj to our Lyaponuv function g(y) =l — y k , 
we have 

Ajg(y) = -yk(e k - y) T Ay 



-Vk 



/.( i^'w ^'^'-^'- 1 )^' 

y k (l + h k (x)) \ \ 

Vk + Vk) + l-y k ] v(dx) 



1 + T, j yjhj(x 

= -yk(e k -y) T Ay 

f ( hk(x) - J2j Vjhj{x) + • yjhj{x)) - h k (x) £ . yjh^x) 
+ -Vk j-ji v(dx) 

Jr\ i + T,jyjhj(x) 
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Imhof [TTJ showed that 

-y k {e k -y) T Ay < -y k [(a + 2/3)y k - 2/3]g(y), (17) 
so we must focus on the integral term. 

For y £ A„, we have 1 + 7 yjhj(x) > 1 + minhj(x) > by Assumption 2.1. Hence, we may just focus on the 

j 

numerator of the integrand to find an inequality. Using the ip k functions defined in the beginning of the section, we 
determine that 



h k{x) - Vj h A x ) + yj h j( x ) - h k(x) Y Vi h A x ) 



v(dx) 



hk{x) - y k h k (x) - Yyj h j( x ) + \ykhk{x) + Y J Vi h "ji x ) ~ Vkh k {x) 2 - h k (x)y^ j y J h j (x) 



v(dx) 



> 



h k (x) 


- y k h k {x) 


-*Pta X ( x )J2 


V] + 


yykh k (x) 4 




ykh k {xf - h k (x)ip^ ax (x)Yyj 






j^k 






3^k J 


3+k . 


h k (x) 


- y k h k {x) 




Vk) - 


(y k h k {x) 


+ V4m(£)(l -Vk)) 2 


- y k h k {x) 2 - h k (x)tfj^ ax {x){l - 


h k (x) 


- y k h k {x) 


-V-L* (*)(!- 


Vk) - 


- vl h k{ x ) 2 


^2y k h k {x)^ k rnm {x){l 


-yk) + ^Ln( x ) 2 (^-yk) 2 



v{dx) 



v(dx) 



y k h k {x) 2 - h k (x)^ ax {x){l - y k ) 



v(dx) 



h k - iPmax( x ) + -Vkh k (x) 2 + 2y k h k (x)ip^ m (x) + ip^ m (x) 2 (l - y k ) - h k (x)^ ax (x) 
- y k (h k {xf - 2h k {x)^ k min {x) + ipi in (x) 2 ^ + i>t in (x) 2 + h k (x) - (1 + h k {x))^ k max {x 



v{dx) ■ (1 - y k ) 
v{dx) ■ (1 - y k ) 



y k (h k {x) - VminW) + ^rmrSx? + M«) ~ (l + h k (x))^ lax (x) 

Hence we have the inequality 

^ (Ei Vjhj ( x )) ~ h k (x) V , Ujl'j ( x ) 



v(dx) • (1 - y k ). 



Ilk 



\ 



l + E 1 yj h j(x) 



v{dx) < -yk 



jk , jk 

h Vk + h 



ff(y). 



(18) 



Thus by Equations (17) and (18) 

Ajgiy) <~y k [(a + 2^I k )y k -(2^-I k )]g(y) := g(y). 

With our assumptions we have g(y) < for every y e A„. For an arbitrary S > 0, define V5 = -fy € A„ : y k > s\, 
and Ty 6 as the first time the process leaves Vs. Then gi s(t A Ty 5 ) ) is a local supermartingale, and thus for y € Vg, 



which implies 



P 9 ( sup g(a(t A TV,)) > 1 - S) < ^4 

\0<t<oo v ' / 1 — 

P,( sup 5 ( S (tA^))<l-^)>l-fM 
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Notice that for e > 0, there is a d > such that g(y) < —d on Vs\U e (ek) ■ Therefore, applying the logic given in the 
proof of Theorem 2 in Kushner [14] , we are able to conclude the theorem. □ 



Remark 5.1. If for all x we have \ip m ax{x) — ipmin{x)\ is small and hk(x) is sufficiently larger than ipmax(x), then 
L\ > 0. Hence, if 2/3 is small enough, we have —2(3 + 1% > 0. Furthermore, if if < 1%, it is very likely that 
2(3 — if > 0, and so a + 2(3 — if > 0. However, if 2(3 — if < 0, then a could be large enough so that a + 2(3 — if > 0. 
A case like this is possible with a\ small and min {\auk — &jk\ '■ 1 < J ' < n an d j ^ k} relatively large. 



Corollary 5.1. Assume that for the pure strategy Sj and the corresponding variance o~"j, we have the inequality 
o-kk > Ojk + o~j for all j ^ k, hi(x) is nonnegative for all i, —2(3 + 1% < 0, a + 2(3 — if > 0, and if < Lf + a/2. Then 

there exists a neighborhood of ek, say V C A„, such that for any y (z V and A = sup 1 — yk\, 

yedv 

P y (hms W = e fc )>l-i-|. 



Proof. From Theorem 5.1, we have the inequality Ajg(y) < —yk (a + 2(3 — lf)yk ~ (2(3 — i|) g(y) Define V = <j y <- 

(a + 2(3 — lf)yk — (2(3 — i|) g(y) is negative for y G V, the rest of the proof 



1 a + 4/3 - 1I\ \ _. 

A n : Vt. > =- >. Since — % 

y 2 a + 2(3 -If J y 

follows the proof given in Theorem 5.1. 



□ 



6 Dominated Strategies 

In the past sections we have shown conditions where our process will converge to a pure strategy but we have not 
considered the possibility of a pure strategy which there is no possibility of convergence. We say that a strategy q is 
dominated by p if for any strategy you play against your better payoff comes from strategy p, i.e., q T Ap' < p T Ap' 
for all p' G A n . In the theorem below, we show under appropriate stochastic perturbations a dominated pure strategy 
becomes extinct. 



Theorem 6.1. Let the pure strategy Sk be dominated by the mixed strategy p G A„. For our payoff matrix A define 

K\ = min {p T Aq — e^Aqj, K2 = — ^ + — y^Pj 17 ?; an d define d ma x = max{cri, . . . , a n }. Suppose that K% < K\, 

3 

and hk(x) < ~^^pjhj{x) for all Then for every y G A n , 

3 

P y (s k (t)=o(^ expji J (h k [x) -Y^Pjhj(x)ji>(dx) - (Ki - K 2 )t + 3a max y/tloglogt^ ^ =1. 

Proof. We will proceed as in Theorem 3.1 (Imhof |llj). Working from the dominating mixed strategy p, define 
G(t) = log (sk(t)) — J^Pj log (sj(t)). Ito's lemma yields 

3 

G(t) =G(0) + J* (e T k As(u) - p T As(u) - ^ + ± du 

+ <JkWk(t)-Y / P3^3Wj(t) 

3 (19) 

Vi + Eift'^wy 
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For the integral f [ log [ =^ — \ ] Nidx.du) notice that the integrand is not dependent on the time 

Jo Jr Vl+Ej-PAW/ 



variable. Hence / / log . 

Jo Jr \ 1 • L ., /'A : •'• : ' 
36.5 in Sato HH] tells us that 



l + h k (x) 



N(dx,du) is a compound Poisson process. Since v[K) < oo, Theorem 



lim — 

t— >CXO t 



' <■ ( l + h k (x) \ f ( l + h k (x) 

log [ - ; — - - )N(dx,du) = / log — \v(dx) a.s. 



1 + E^AO 15 ) 



Therefore 



lim - 

t— s-oo £ 



log 



l+_fefc(x) 



1 + F,jPjhj{ x ) 



N(dx, du) = a.s. 



Now for (7 



1/2 



(1 -Pk)V2+5^<7? , we see that W[t) := a fc W^t)-^ ft< 7^(t) 



/a is a standard Wiener 



process, and that a < 3er max . Thus, P y almost surely 



G{t) < G(0) + (Ki -K 2 y + aW(t) + f f log ( 

Jr\, Vi + Ej-pAw 



i + EjPAC 3 



N(dx,du) 



+ t 

Therefore, applying the Law of the Iterated Logarithm, we see that 



v(dx). 



lim sup s k (t) exp 



< lim sup exp 

t— >oo 



< lim sup exp 

t— >00 



t J yhk(x) - ^p j h J (x) S jv(dx) - {Ki - K 2 )t - 3<r max \Aloglogi 
G{t)+t J [h k (x) - ^pjhjjxjj^dx) - (K\ - K 2 )t - 3a max y^t log log t 



G(0) + / * [log( - 1 + hk ^\ ) N (dx,du)+t I K,, 



o Jr 



i + Ej^AO) 



l + fefc(x) 

i + E,pAO) 



v(dx) 



5W{t) - 3cr maxV /ilog logl 



0. 



(20) 



(21) 



□ 
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